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Summary. 

Estimation  is  considered  in  a model  where  both  the  mean  vector 
and  the  dispersion  matrix  have  linear  decompositions.  It  is  shown  that 
after  an  invariance  reduction  with  respect  to  mean  translation,  MINQUE 
provides  a nonnegative  definite  estimate  of  the  dispersion  matrix,  when 
the  decomposing  matrices  span  a quadratic  subspace  of  symmetric  matrices. 
With  normality,  MINQUE  is  seen  to  equal  the  restricted  maximum  likelihood 
estimate  and  to  be  of  uniformly  minimum  variance. 


KEY  WORDS:  MINQUE.  Noniterative  solution  of  likelihood  equations. 

Quadratic  subspaces.  REML.  Special  Jordan  algebra.  UMVU. 
Uniqueness  of  maximum  likelihood  estimate. 
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1.  Introduction.  Consider  independent  and  identically  distributed 

n . T5 

random  (R.  -vectors  Y , a = 1,...,N,  with  common  mean  vector  S1  b x 

=a  ir=l  ir='fT 

and  common  dispersion  matrix  S'  t V , where  interest  concentrates  on 

K=1  K=K 

estimating  the  vector  t :=  (t^,  . ..,  t^) 1 of  dispersion  coefficients. 
Various  procedures  have  bean  discussed  in  the  literature.  Among  those 
are:  (i)  minimum  norm  unbiased  quadratic  invariant  estimation 

(MINQUE,  C.R.  Rao  [ 8,  p.  302]),  and,  under  normality,  (ii)  uniform 
minimum  variance  unbiased  invariant  estimation  (UMVU,  Seely  [9]),  and 
(iii)  restricted  (by  invariance)  maximum  likelihood  estimation  (REML, 
Corbeil  & Searle  [2]).  In  this  paper  invariance  is  to  be  understood 
with  respect  to  the  group  of  all  mean  translations 

(ya-y  + Sb  x I (b.,  ...,  b ) 1 G RP  },  a maximal  invariant  statistic 
=:  - TT  =TT  1 P 

being  MY  where  M projects  orthogonally  onto  the  orthogonal  complement  of 
the  space  spanned  by  x , x ; hence  reduction  by  invariance  yields 

j.  p 

the  residual  vectors  MY  with  mean  0 and  dispersion  matrix  St  MV  M . 

=-a  = k==k= 

Our  main  result  may  be  roughly  summarized  as  follows:  If  estimates 

according  to  each  of  the  three  procedures  above  exist,  then  they  coincide, 

and  the  common  estimate  t yields  a nonnegative  definite  estimate  St  MV  M 

K — K — 

of  the  dispersion  matrix  in  the.  invariance  reduced  model.  This  holds 
true  for  any  finite  sample  size  N > v :=  rank  M,  in  contrast  to  asymptotic 
results  on  consistency  as  N -*  00  , cf.,  Anderson  [ l]  . 

In  Section  2,  the  invariance  reduced  model  is  discussed  in  a normal 
setting,  and  Section  3 is  concerned  with  the  linear  model  situation. 
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The  vital  assumption  is  the  condition  of  Seely  [9]  that 

MV-jM,  MV^M  sPan  a k-dimensional  quadratic  subspace  B of  symmetric 

n x n matrices.  The  subspace  B is  quadratic  if  and  only  if  A G 8 
whenever  A € 8 , i.e.,  8 is  closed  under  the  multiplication 
A ° B :=  “(AB+BA)  . Jensen  [ 4]  points  out  that  the  latter  property  makes 
B into  a k-dimensional  special  Jordan  algebra,  and  we  shall  adopt  this 
more  informative  terminology.  For  a discussion  with  no  initial  invariance 
reduction,  see  Gnot,  Klonecki  & Zmyslony  [ 3]. 

= ‘ ====—!=—— ” We  w-*-H  use  the  isomorphism  vec  that  maps  a 
matrix  into  a vector  by  ordering  its  entries  lexicographically,  see 
Pukelsheim  [ 7 ] . 

THEOREM  1.  Consider  independent  and  identically  normally  distri- 
buted random  Wl*  -vectors  Z^  with  common  mean  0 and  common  dispersion 
matrix  2t  W , where  U > v . Assume  that  the  k decomposing  matrices 
WK  span  a k- dimensional  special  Jordan  algebra  B . Define  G c pk  to 
be  the  region  of  those  values  t of  the  dispersion  parameter  such  that 
St  W is  positive  definite,  and  assume  G ^ 0 . Then: 

(a)  The  maximum  likelihood  estimator  for  t £ G is  almost  surely 

equal  to  the  uniform  minimum  variance  unbiased  estimator 

+>  —1 

t : = (DD)  D'*vec§,  where  D :=  [ vecW^  : ...  : vecW^  ] , and 

S ;=  2z  Z '/N  . 

- =a  =a 

A A 

(b)  The  estimated  dispersion  matrix  W :=  St  W is  nonnegative 

K K 

definite;  in  fact,  if  the  sample  dispersion  matrix  S is  positive  definite, 

A 

so  is  W . 
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Proof.  (a)  Since  G is  open  and  connected  it  is  a region,  and 
its  boundary  9g  consists  of  those  t G p such  that  St  W is  nonnegative 

“ K — K 

definite  and  singular.  The  sample  dispersion  matrix  S is  almost  surely 
positive  definite.  If  t tends  to  9g,  or  ||t[|  tends  to  03  , the  likelihood 
function  L tends  to  zero  [ 1,  p.  5]  . Since  L is  positive  in  G there 
exists  a maximum  in  G,  and  no  maximum  lies  on  the  boundary  9g.  Hence  the 
maximum  likelihood  estimate  is  a solution  of  the  likelihood  equations 

(1)  D'F-1Dt  = D,F~1vecS  , 
where  the  matrix  of  fourth  moments 

(2)  F = F(t)  :=  (St  W )0(2t  W ) . 

= = = K=K  K=K 

If  F in  (1)  is  put  equal  to  F(tQ)  for  some  given  tQ  G G , then  (1)  is  a 
set  of  weighted  normal  equations,  cf.  [ 7,  p.  628]  , and  hence  yields  a 
minimum  variance  unbiased  estimator  for  the  vector  parameter  t . Since 
the  matrices  span  a special  Jordan  algebra,  there  exists  an 
almost  surely  unique  uniform  minimum  variance  unbiased  invariant  estimator 
which  does  not  depend  on  the  choice  of  t G G . Thus 

(3)  £ = (D'D)  1D'vecS  , 

since  G / 0 implies  the  existence  of  a nonsingular  matrix  B G 6 , and  so 
B G B and  I = B o B G B ; the  matrix  F in  (1)  may,  therefore,  be  set 
equal  to  12=101. 
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(b)  As  a linear  operator  on  the  space  of  symmetric  matrices,  t 
is  surjective  and  hence  open,  and  so  if  for  some  positive  definite 

A 

matrix  SQ  the  value  t(SQ)  ^ G , the  same  is  true  for  an  open 
neighbourhood  of  SQ  , i.e.,  for  a set  of  positive  Lebesgue  measure. 
This  contradicts  part  (a)  that  t maps  into  G almost  surely.  For  a 
singular  sample  dispersion  matrix  S , consider  the  limit  S + el^  as  e 
tends  to  zero.  Q.E.D. 

Part  (a)  may  also  be  obtained  from  a reparametrization  by 

8 = 0(t)  , where  the  bijection  0 from  G onto  G solves 

20  ( t) W = (2t  W ) 1 , as  introduced  by  Seely  [9,  p.  715].  In  this 
K = =K  K = K 

case  one  obtains  an  exponential  family  in  the  vector  parameter  6 and 
standard  theory  applies,  cf.  Anderson  [ l]  . A theorem  proved  by 
Makelainen,  Schmidt  & Styan  [6]  may  be  used  to  obtain  uniqueness  of 
the  solution  to  the  likelihood  equations  (1) . 

3.  The  Multivariate  Linear  Model.  We  now  return  to  the  linear,  but 
not  necessarily  normal,  model  discussed  in  Section  1. 

THEOREM  2.  Consider  independent  and  identically  distributed 

random  £R n -vectors  Y , a =1,...,N,  with  common  mean  vector  2b  x and 

=a 

common  dispersion  matrix  2t  V , where  N k v = rank  M . Assume  that 

KC — K 

the  k matrices  MV^M  span  a k- dimensional  special  Jordan  algebra  8 that 
contains  M . Let  DM  :=  [ vecMV,  M : ...  : vecW^M  ] . Then  the  MINQUE 

(4)  t = (D' D )_1D' -vecS 

= = M=M  =M  = 
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for  t yields  a nonnegative  definite  estimate  St  MV  M of  the  invariance 

- K==K= 

reduced  dispersion  matrix,  this  estimate  being  of  rank  v if 
| :=  (MY^) '/N  is  of  rank  v . 

Proof.  It  is  easily  checked  that  t is  the  MINQUE  in  the  enlarged 

model  [Y^M  : : Y^M  ] ! ~ (0,  ZU^W  M).  The  rest  will  be  proved 

by  reference  to  Theorem  1.  Choose  an  nxv  full  rank  v factor  Q of  M , 

i.e.,  M = QQ1  and  Q'Q  = I ; then  Q'Y  is  another  maximal  invariant 

statistic  [ 5,  p.  707]  . For  the  sole  reason  the  proof,  add  a normality 

assumption.  Then  Theorem  1 is  applicable  to  Z :=  Q'Y  , and  yields 

=a  = =a. 

the  same  t as  in  (4) ; and  the  results  on  ^t^Q'V^Q  imply  the  assertions 
on  St^MV^M  . Q.E.D. 

If  a normality  assumption  is  added  to  Theorem  2,  then  using 
Theorem  1,  we  obtain  the  following: 

COROLLARY.  If  the  common  distribution  of  Y, , . . . , Y is  normal, 

=1  =N 

A 

then  t is  the  UMVU  and  RE ML  estimate  of  t , as  well  as  the  MINQUE. 

Examples  may  be  found  in  Corbeil  and  Searle  [ 2 ] . In  each  one  of 
their  four  cases  a special  Jordan  algebra  is  present:  equality  of  MINQUE 
(i.e.,  ANOVA  estimators)  and  REML  is  implied  by  the  Corollary  and  need 
not  be  checked  explicitly,  nor  need  the  likelihood  equations  be  solved 
iteratively . 

="  ===S===i§2-==--- • This  paper  was  presented  at  the  Instytut  Mate- 

matyczny  PAN,  Wroclaw,  by  the  first  author,  who  would  like  to  thank  the 
Polish  Academy  of  Sciences  for  their  kind  invitation.  The  authors  would 
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